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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments filed March 31 , 2009 have been fully considered but they 

are not persuasive. 

The Applicant argues that Ross fails to disclose auxiliary information 
regarding a first (or current) frame and thinks the Examiner is reading this as the 
actual frame data or encoded frame data as well as Ross in view of Chiba et al. 
fails to meet the claimed limitations of claim 1 . The Examiner respectfully 
disagrees. The Examiner is reading the auxiliary information as the value that is 
determined by the accumulator which represents the accumulated average value 
of for the associated frame (col. 3, lines 10-30). Therefore, by the Examiner 
reading the accumulated average value of for the associated frame as the 
auxiliary information it is possible to still have auxiliary information as well as 
video frame data representing the actual picture for each frame. Furthermore, 
Ross discloses comparing the accumulated average values between two frames, 
thereby determining a difference (col. 3, lines 31-39). The Chiba et al. reference 
is relied upon to disclose encoding the video bit stream as well as annotating a 
difference in the bit stream once a difference has been determined (Figs. 5-7, 64, 
and 65; col. 41, lines 14-19 and 40-55). Chiba et al. discloses annotating the 
difference by placing mark signal is indicated in the video stream to show a 
scene change once a difference has been determined (col. 41, lines 50-55). The 
limitation regarding the annotation is broad enough to be read on the scene 
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simply being marked. Therefore, Ross in view of Chiba meet the limitations of 
claim 1 and the rejection is maintained. 

2. The Examiner missed claims 3 and 6 in the last Office Action, which should have 
been regarded as objectable. Therefore, since two claims were missing previously this 
action is deemed non-final. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1, 2, 4, 5, 7, 9-12, 16, and 18-21 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Ross et al. (U.S. Patent 5,880,775) in view of Chiba et al. (U.S. 
Patent 5,614,960). 

Regarding claim 1, Ross discloses a method comprising: maintaining a 
current state of auxiliary information regarding a first frame of a sequence of 
video frames in storage in a local device hardware memory (Fig. 2; col. 3, lines 9- 
30 - the average pixel value is stored in the corresponding register); using an 
electronic comparator to compare the stored current state of auxiliary information 
with auxiliary information regarding a later current video frame of the sequence of 
video frames to determine differential information (Fig. 2; col. 3, lines 31-39); 
Ross fails to explicitly disclose that the sequence of video frames are encoded as 
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a video bit stream having video frame data for each respective video frame of the 
sequence of video frames as well as annotating the differential information to the 
video bit stream as an annotation to the video frame data for the current frame 
only if the differential information indicates a change from the current state of the 
auxiliary information. 

Referring to the Chiba et al. reference, Chiba et al. discloses a method 
wherein the sequence of video frames are encoded as a video bit stream having 
video frame data for each respective video frame of the sequence of video 
frames (Figs. 5-7 - encoding steps) and detecting a scene change as well as 
annotating the differential information to the video bit stream as an annotation to 
the video frame data for the current frame only if the differential information 
indicates a change from the current state of the auxiliary information (Figs. 64 
and 65; col. 41, lines 14-19 and lines 40-55). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have encoded the bitstream and to annotate 
the difference in images (scene changes) into the video bit stream as disclosed 
by Chiba et al. in the method disclosed by Ross in order to easily discriminate a 
frame that constitutes a scene change against a normal frame. 

Regarding claim 2, Ross in view of Chiba et al. discloses all the limitations 
as previously discussed with respect to claim 1 including that the current state of 
auxiliary information indicates the latest encoded information (Ross: Fig. 2; col. 3, 
lines 10-30). 
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Regarding claim 4, Ross in view of Chiba et al. discloses all the limitations 
as previously discussed with respect to claim 1 including that the auxiliary 
information comprises video processing information regarding video frames 
(Ross: Fig. 2; col. 3, lines 10-30). 

Regarding claim 5, Ross in view of Chiba et al. discloses all the limitations 
as previously discussed with respect to claim 1 as well as further comprising 
encoding the differential information before annotating the differential information 
(Chiba et al.: Figs. 5-7, 64, and 65; col. 41, lines 14-19 and lines 40-55 - the 
difference information is encoded). 

Regarding claim 7, Ross in view of Chiba et al. discloses all the limitations 
as previously discussed with respect to claim 1 including that annotating the 
differential information comprises extending the video bit stream format to include 
the differential information (Chiba et al.: Figs. 5-7, 64, and 65; col. 41, lines 14-19 
and lines 40-55; Fig. 65 displays more information being annotated to the video 
bit stream thereby extending the video bit stream). 

Regarding claim 9, Ross in view of Chiba et al. discloses all the limitations 
as previously discussed with respect to claim 1 as well as the method further 
comprising gathering the video information regarding the current video frame 
(Ross: Fig. 2; col. 3, lines 10-30). 

Regarding claim 10, Ross in view of Chiba et al. discloses all the 
limitations as previously discussed with respect to claims 1 and 9 including that 
the differential information comprises the difference between the current state of 
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the auxiliary information and the gathered information (Ross: Fig. 2; col. 3, lines 
10-39; Chiba et al.: Figs. 5-7, 64, and 65; col. 41, lines 14-19 and lines 40-55). 

Regarding claims 11 and 12, these are machine-readable medium claims 
corresponding to the method claims 1 and 2. Therefore, claims 1 1 and 12 are 
analyzed and rejected as previously discussed with respect to claims 1 and 2. 

Regarding claims 16 and 18-21, these are apparatus claims 
corresponding to the method claims 1, 2, 4, and 5. Therefore, claims 16 and 18- 
21 are analyzed and rejected as previously discussed with respect to claims 1 , 2, 
4, and 5. 

Allowable Subject Matter 

5. Claims 3, 6, 1 3-1 5, 1 7, 22, 24, and 25 are objected to as being dependent upon 
a rejected base claim, but would be allowable if rewritten in independent form including 
all of the limitations of the base claim and any intervening claims. 

6. The following is a statement of reasons for the indication of allowable subject 
matter: Prior art fails to teach or fairly suggest a method, recording medium, or an 
apparatus comprising: 

a. Wherein the auxiliary information comprises additional non-visual 
information regarding video frames (claims 3, 13, and 17). 

b. Wherein the encoded differential information comprises a list of 
parameters; the parameters being described in a tag lookup table (claims 6, 14, 
and 22; claim 15 depends from claim 14). 
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c. Wherein the auxiliary information comprises additional non-visual 
information regarding camera geometry and identification for the video frames 
(claim 24). 

d. Wherein the auxiliary information comprises video processing information 
regarding descriptions and camera positions for the video frames (claim 25). 

7. Claim 23 is allowed. 

8. The following is an examiner's statement of reasons for allowance: Prior art fails 
to teach or fairly suggest an apparatus comprising: a state storage memory coupled to 
the collector to store the current state of the auxiliary information; a comparator to 
receive the auxiliary information and compare the stored current state of the auxiliary 
information with auxiliary information regarding a later current video frame of the 
sequence of video frames to determine differential information; and a tag lookup table 
defining settable parameters; an annotator to store the differential information using the 
settable parameters in the video bit stream by extending the original bit stream format 
only if the differential information indicates a change from the current state of the 
auxiliary information. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HEATHER R. JONES whose telephone number is 
(571 )272-7368. The examiner can normally be reached on Mon. - Thurs.: 7:00 am - 
4:30 pm, and every other Fri.: 7:00 am - 3:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thai Tran can be reached on 571-272-7382. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Heather R Jones 
Examiner 
Art Unit 2621 

HRJ 

June 18, 2009 
/Thai Tran/ 

Supervisory Patent Examiner, Art Unit 2621 



